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Overview 


•  Background,  “The  Fog  of  More 

•  Research  Approach 

•  The  Problem 

•  Methodology 

•  Proposed  Model 

•  Conclusion 
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The  Fog  of  More... 


A  Quest  for  Excellence 


Final  Report  to  the  President 

by  the  President's 
Blue  Ribbon  Commission 
on  Defense  Management 


June  1986 


» 


Removing  bureaucratic  inefficiencies  in  our 
acquisition  of  major  weapon  systems  *•*.  The 
[PM]  finds  that ,  far  from  being  the  manager  of 
the  program ,  he  is  merely  one  of  the 
participant^  who  can  influence  it.  An  army  of 
advocates  for  special  interests  descends  on 
the  program  (Packard  Commission) 
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•  “We  surveyed  24  program  managers  that 
held  a  milestone  B  or  C  decision  since  2010 
and  found  that  it  took  them  over_  2  years  op 
average  to  complete  the  entire  set  of 
documents  needed  for  the  milestone 
decision.  The  program  managers ,  as  well  as 
other  acquisition  officials  we  surveyed, 
considered  on  average  about  half  of  the 
information  requirements  as  np t  highly 
valued. "  (gao,  2015) 


Gm 


United  States  Government  Accountability  Office _ 

Report  to  Congressional  Committees 


ACQUISITION 

REFORM 

DOD  Should 
Streamline  Its 
Decision-Making 
Process  for  Weapon 
Systems  to  Reduce 
Inefficiencies 


GAO-15-192 


The  Approach 
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•  Multi-phased  Effort  to  address  acquisition  reform  at  the  PM 
level — where  projects  are  actually  managed 

•  Using  Enterprise  Systems  Engineering  (ESE)  develop  a 
system  model  of  Program  Management  Office  (PMO) 
functions 

-  ESE  links  systems  management  to  process  execution 


( This  Phase) 
Literature  review 
Model  development — 


( Data  Collection) 


instrument 

Observation 

Interviews 


(Analysis) 


PMO  Processes 


The  Problem 


“Curiously  despite  the  enormous  attention 
project  management  and  analysis  have 
received  over  the  years,  the  track  record 
of  projects  is  fundamentally  poor, 
particularly  for  the  larger  and  more  difficult 
ones.  Overruns  are  common.  Many 
projects  appear  as  failures,  particularly  in 
the  public  view.  . .  .[Wjhy  does  the  record 
so  consistently  show  project  overruns  to 
be  the  norm?  Is  this  the  indictment  of 
project  management  that  it  seems?  (Morris  & 

Hough,  1988) 
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the. 

anatomy 

of. 

major , 
projects 


A  Study  of  the  Reality  of 
Project  Management 


Morris  and  Hough 


Is  this  a  policy  or  management  problem? 


Project  Management  as  System 
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•  An  enterprise  system  consists  of  a  purposeful  combination 
(e.g.,  a  network)  of  interdependent  resources  (e.g.,  people, 
processes,  organizations,  supporting  technologies,  and 
funding)  that  interact  with  each  other  to  coordinate 
functions,  share  information,  allocate  funding,  create 
workflows,  and  make  decisions,  etc.;  and  their 
environment(s) 


•  A  network  of  many  variables  in  casual  relationships  = 
incomplete  knowledge* 

-  Interdependent 

-  Dynamic 

-  Unstable 


-  Opaque 

.  *D.  Dorner;  P.  Nixon;  S.  D.  Rosen,  Philosophical  Transactions  of  the  Royal 

—  Uncertain  Society  of  London.  Series  B,  Biological  Sciences,  Vol. 327,  No.  1241,  Human 

Factors  in  Hazardous  Situations.  (Apr.  12,  1990),  pp.  463-473. 


Acquisition  as  Enterprise  System 
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Process,  Functions  &  Management 


NAVAL 


Stakehol 
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Complexity  Reports 
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Enterprise  System  Engineering 

O  Interdependence 
O  Processes 
O  Social 

O  People 

O  Optimized  for  Job  satisfaction 
O  Technical 

O  Procedures 
O  Technology 
O  Optimized  for  efficiency 


Project  Management  Tasks 
o  Activity  Management 
o  Configuration  Management 
o  Resource  Management 
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Process  Growth  Through  Life  Cycle 
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User  Needs 


Technology  Opportunities  &  Resources 


More  Information  about  the  DAS 
Integrated  Life  Cycle  at 

https://ilc.dau.mil/ 


IOC 


FOC 


Materiel 

Solution 

Analysis 


Materiel 
Development 
'^'fQecIsion 


Technology* 


Engineering  &  Manufacturip 


Production  & 
Deployment 
LRIP  f  Full-Rate  Prod 
&  Deployment 


Operations  & 
Support 

Litjbycle 

Sustainment 

Disposal 


Sustainment 


Decision  points:  6 


PDR  Preliminary  Design  Review 
CDR  Critical  Design  Review 
LRIP.  Low  Rate  Initial  Production 
FRP:  Full  Rate  Production 


•Acquisition  Decision  Memorandum  (ADM) 

■Analysis  of  Alternatives  (AoA)  (update) 

•Acquisition  Strategy 
•Affordability  Assessment 
•Acquisition  Program  Baseline 
•Acquisition  Information  Assurance  Strategy 
•Benefit  Analysis  &  Determination 
•Capability  Production  Document  (CPD) 
•Title40/Clinger  Cohen  Act  (CCA)  Compliance 
•CIO  Confirmation  of  CCA  Compliance  (for  MDAPs  & 
MAIS.  DoD  CIO  confirms) 

•Consideration  of  Technology  Issues  (ACAT  i  &  I!) 
•Competition  Analysis 
•Component  Cost  Estimate  (CCE) 

•Cooperative  Opportunities 
•Core  Logistics  Analysis/Source  of  Repair  Anafysis 
•Cost  Analysis  Requirements  Description  (CARD) 
(MQAP  &  MAJS) 

•Corrosion  Prevention  Control  Plan 

•Data  Management  Strategy  (In  acquisition  strategy) 

•Exit  Criteria 

•Initial  Capabilities  Document  (ICD)  (rf  program 
initiation) 

•independent  Cost  Estimate  (ACAT  i) 


•Independent  Technology  Readiness  Assessment 
(TRA)  (ACAT  ID) 

•Information  Support  Plan  (ISP) 

•Industrial  Base  Capabilities  (MOAP) 

•Item  Unique  Identification  Plan  (SEP  annex) 

•Life  Cycle  Sustainment  Plan  (LCSP) 

•Life  Cycle  Signature  Support  Plan 
•Manpower  Estimate  (MDAP) 

•MDA  Program  Certification  (if  program  initiation) 

•Military  equipment  valuation  (in  acquisition  strategy) 
•Net-Centric  Data  Strategy  (in  ISP) 

•Operational  Test  Agency  OT&E  Report 
•Program  Protection  Plan  (PPP) 

•Programmatic  Environment.  Safety.  &  Occupational 
Health  Evaluation  (PESHE) 

•Selected  Acquisition  Report  (SAR)  MDAP  (if  rebaselmed) 
•Spectrum  Supportability  Determination 
•Systems  Engineering  Plan  (SEP) 

•System  Threat  Assessment  Report  (STAR)fACAT  0 

•System  Threat  Assessment  (ACAT  II) 

•Technology  Readiness  Assessment  (TRA) 

•Test&  Evaluation  Master  Plan  (TEMP) 


•Acquisition  Decision  Memorandum  (ADM) 
•Analysis  of  Alternatives  (AoA) 

•Acquisition  Information  Assurance  Strategy 
•Clinger-Cohen  Act  (CCA)  Compliance 
•CIO  Confirmation  of  CCA  Compliance  (for 
MDAPs  &  MAIS,  DoD  CIO  confirms) 
•Consideration  of  Technology  Issues 
•Component  Cost  Estimate  (CCE) 
•Economic  Analysis  (MAIS) 

•Exit  Criteria 


•Initial  Capabilities  Document  (ICD) 

•Item  Unique  Identification  (IUID) 

Implementation  Plan 

•Life  Cycle  Signature  Support  Plan 

•Market  Research 

•MDA  Program  Certification 

•Program  Protection  Plan  (PPP) 

•Systems  Engineering  Plan  (SEP) 
•Technology  Development  Strategy  (TDS) 
•Test  &  Evaluation  Strategy  (TES) 


•Initial  Capabilities  Document  (ICD) 

AoA  Study  Guidance  (AoA  Plan  due  immediately  following  the  MDD) 
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Project  Management  is  Accomplished  by 
Processes 


\ 

Project  Management  Tasks 

Are  Executed  through  defined  PMO  Processes  in  Three  Main  Areas 

Administration 
■  Data  Calls 
Reports 

Activity  Management 

Configuration 

Management 

Resource  Management 

Influenced  by  Capacity/  Conflict/  Context/  Complexity  J 

Planning 

Scheduling 

Analyzing 

Reporting 

Product  Management 
Change  Management 

Identification 

Acquisition 

Tracking 

Application 
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Successful  Weapons  System  Development 
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Characteristics  of  Process* 
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•  Define  how  the  work  of  the  organization  is  done 

•  Logical  organization  of  people,  materials,  energy,  equipment 
and  procedures  into  work  activities  designed  to  produce  a  result. 

•  Set  of  processes  lead  to  the  accomplishment  of  a  task 

•  Cross  organizational  boundaries  (between  tasks  and 
organizations) 

•  Process  Entities 

-  Interorganizational 

-  Interfunctional 

-  Interpersonal 

•  Process  Activities 

-  Operational 

-  Managerial 


A  Quantitative  and 
Qualitative  Approach  to 
Acquisition  Research  is 
Essential 


‘Davenport,  T.  (1990).  The  New  Industrial  Engineering:  Information  Technology  and  Business  Process  Redesign  |  MIT  Sloan 
Management  Review.  MIT  Sloan  Management  Review.  Retrieved  from  http://sloanreview.mit.edu/article/the-new-industrial- 
engineering-information-technology-and-business-process-redesign/ 


Analytical  Framework 


•  Systems  Engineering 

-  Enterprise  Systems  Engineering 

-  Business  Process  Reengineering 

-  Socio-political 

-  PMO  process  classification 

-  PMO  process  categories 

•  Management  Science 

-  Decision  making 

-  Change  __ 


Input 
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IDEFO  Modeling  Approach 


Ct^rol 


Transformation 


I 


Output 


Mechanism 


Process  Elements 


•  Work  Decision 

•  Resources 

•  Information 

•  Decision 


cequest  for 
Information/ 
Decision 
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Information  +  Resources  +  Work 


Resources 


Transformation 


Decisior 


T 

PMO  Personnel 


Process  Category  Level 
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Capacity/  Scope 

-  Amount  of  work  that  can  be  performed  by  the  PMO  in  a  set  amount  of  time 

-  Finite  measure — internally  generated  capacity  or  externally  contracted 

-  Metrics  =  actions,  processes,  decisions  and  completed  tasks 

Confict  I 

Conflict 

-  People,  system  and  organization  * 

-  Matrix  environment  challenges 

Context 

-  PMO  ecosystem 

-  Stakeholders 

-  Communication 

Complexity 

-  System  focused 


-  Structural,  Dynamic,  Socio-political,  interdependence 

Value 


t 


Complexity 


Process  Categories 


Conflict 


Capacity 


(equest  tor 
Information/ 
Decision 


Resources 


1 


Transformation 


PMO  Personnel 


Decisior 


Context 


---AIN  PS;  A 
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Complexity 


Process  Model 


PMO  Business  Process 


Element 


1.1 


Information 


1.3 


Resources 


_ ' 

1.4 

1 

Decisions 


Category 

f 

Performance 

1 

2.1 

f  ^ 

3.1 

Capacity 

L _ A 

Cost 

r - ^ 

f  ^ 

2.2 

3.2 

Conflict 

Time 

_ [\ 

L. _ A 

o 

2.3 

3.3 

Context 

Quality 

t _ j 

r  ^ 

2.4 

3.4 

Complexity 

Benefit 

t _ j 

^  A 

— i 

—j 
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Conclusion 
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•  Reform  will  not  come  from  top-driven  initiatives  alone — A 
systems  approach  that  links  the  systems  management 
level  to  PMO  processes  can  help  identify  best  practices 

•  An  enterprise  systems  engineering  approach  provides  a 
framework  for  examining  PMO  activities  and  decisions 

•  Process  Level  analysis  will  help  extend  research  beyond 
policy  adjustments  to  get  at  the  heart  of  acquisition  change 

•  Process  focused  analysis  will  identify  those  value  adding 
and  key  decision  process  activities  in  the  PMO 

•  A  broad  systems  approach  to  the  entire  acquisition  system 
will  ensure  a  more  complete  understanding  of  the 
challenges  and  lead  to  better  solutions 
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IDEF  Modeling  Norms 


Control 

Represents  the 
conditions 
required  to 
product  the 
i  f  output  by  the 
^Huncfior^^^“ 


Input 

Represents  the 
things  which  will 
be  transformed 
by  the  function 


Function 

Represented  by  a 
verb/verb  phase  which 
describes  what  is  to  be 
accomplished  by  the 
function. 


► 


Node  Name  ao 

Represents  the 
means  to 
perform  the 
function 
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► 


Output 

Represents  the 
results  of  the 
function  and  the 
transformation  of 
inputs 


► 


Definitions 
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•  System:  A  set  of  interacting  or  interdependent  components 
forming  an  integrated  whole. 

•  Reengineering:  The  fundamental  rethinking  and  radical 
redesign  of  core  business  processes  to  achieve  dramatic 
improvements  in  critical  performance  measures  such  as 
quality,  cost,  and  cycle  time. 

•  Process:  a  structured,  measured  set  of  activities  designed 
to  produce  a  specific  output  for  a  particular  customers  or 
market. 


